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Abstract. The objective of this paper is to improve the customary definition of redun- 
dancy by providing quantitative measures in its place, which we coin upper and lower redun- 
dancies, that match better with an intuitive understanding of redundancy for finite frames 
in a Hilbert space. This motivates a carefully chosen list of desired properties for upper and 
lower redundancies. The means to achieve these properties is to consider the maximum and 
minimum of a redundancy function, which is interesting in itself. The redundancy function 
is defined on the sphere of the Hilbert space and measures the concentration of frame vectors 
around each point. A complete characterization of functions on the sphere which coincide 
with a redundancy function for some frame is given. The upper and lower redundancies 
obtained from this function are shown to satisfy all of the intuitively desirable properties. 
In addition, the range of values they assume is characterized. 



1. Introduction 

The theory of frames is nowadays a very well established field in which redundancy appears 
both as a mathematical concept and as a methodology for signal processing. Frames ensure, 
for instance, resilience against noise, quantization errors and erasures in signal transmissions 
[T§] . Recently, the ability of redundant systems to provide sparse representations has been 
extensively exploited [5] • Hence, it is fair to say that frames - or redundant systems - have 
become a standard notion in applied mathematics, computer science, and engineering. 

Therefore one would expect that the 'redundancy' of a frame, at least in finite dimensions, 
is a well-explored concept. However, to the best of the authors' knowledge, there does not 
exist a precise quantitative notion of redundancy other than the number of frame vectors per 
dimension. From a scholarly point of view, this is a rather unsatisfactory definition. It does 
not distinguish between the two toy examples of frames {ei, ei, ei, e 2 } and {ei, e l5 e 2 , e 2 } in 
M 2 (ei and e 2 being the canonical orthonormal basis vectors), as one might wish, nor does it 
provide much insight into properties of the frame. Its main advantage is that for unit-norm 
tight frames it equals the value of the frame bound. Hence, although the idea of redundancy 
is the crucial property in various applications and thus the foundation of frame theory, a 
mathematically precise, meaningful definition is missing. 
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In this paper, we take a systematic approach to the problem of introducing a quantitative 
notion of redundancy for finite frames in a Hilbert space TC, say, by first establishing a 
list of desiderata that such a quantity should satisfy. We then propose a definition of a 
redundancy function on the unit sphere in 7i, which is shown to satisfy all the postulated 
conditions, thereby immediately supplying us with a detailed list of properties of a frame 
that its redundancy reveals. 

1.1. Review of Finite Frames. We start by fixing our terminology while briefly reviewing 
the basic definitions related to frames. Let 7i denote an n-dimensional real or complex 
Hilbert space. In this finite-dimensional situation, $ = {<^>i)f = i is called a frame for 7Y, if 
it is a - typically, but not necessarily linearly dependent - spanning set. This definition is 
equivalent to ask for the existence of constants < A < B < oo such that 

TV 

A\\x\\ 2 < K X >V^)| 2 < B M\ 2 f o r all x G H. 

i=l 

When A is chosen as the largest possible value and B as the smallest for these inequalities to 
hold, then we call them the (optimal) frame constants. If A and B can be chosen as A = B, 
then the frame is called A-tight, and if A — B — 1 is possible, $ is a Parseval frame. A 
frame is called equal-norm, if there exists some c > such that \\<^i\\ = c for all z = 1, . . . , N, 
and it is unit-norm if c = 1. 

Apart from providing redundant expansions, frames can also serve as an analysis tool. In 
fact, they allow the analysis of data by studying the associated frame coefficients ((x, fi))fLi, 
where the operator T$ defined by T$ : Ti — > ^({l, 2, . . . , N}), ih ((x, tpi))f =1 is called the 
analysis operator. The adjoint T| of the analysis operator is typically referred to as the 
synthesis operator and satisfies T|((cj)^ 1 ) = JZiLi^i- The main operator associated with 
a frame, which provides a stable reconstruction process, is the frame operator 

TV 

i=i 

a positive, self-adjoint invertible operator on Ti. In the case of a Parseval frame, we have 
S*$ = Id^. In general, S$ allows reconstruction of a signal x G 7i through the reconstruction 
formula 

TV 

x = ^2(x,S^ 1 (p i )ip i . (1) 

i=l 

The sequence (S^tpi)^ which can be shown to form a frame itself, is often referred to as 
the canonical dual frame. 

We note that the choice of coefficients in the expansion ([1]) is generally not the only possible 
one. If the frame is linearly dependent - which is typical in applications - then there exist 
infinitely many choices of coefficients (ci)f =1 leading to expansions of x G 7i by 



TV 
i=l 



(2) 
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This fact, for instance, ensures resilience to erasures and noise. The particular choice of 
coefficients displayed in (prj is the smallest in £ 2 norm [TT], hence contains the least energy. 
A different paradigm has recently received rapidly increasing attention, namely to choose 
the coefficient sequence to be sparse in the sense of having only few non-zero entries, thereby 
allowing data compression while preserving perfect recoverability (see, e.g., [5] and references 
therein) . 

For a more extensive introduction to frame theory, we refer the interested reader to the 
books [12], [20j E] as wen as to the survey papers [UJ ITS] . 

1.2. Problems with the Customary Notion of Redundancy. The previous subsection 
illustrated the fact that frame theory is entirely based on the notion of redundancy. So far, 
the redundancy of a frame $ = for an n- dimensional Hilbert space 7i was generally 
understood as the quotient — , a customary, but somewhat crude measure as we will illustrate 
below. If the finite frame is unit-norm and tight, then this quotient coincides precisely with 
the frame bound, which in this case might indeed serve as a redundancy measure. But let 
us consider the two frames $i s and $2 for 7~t defined by 

$i, s = { e i, • • • , ei, 62, es, . . . , e„}, where e\ occurs s times, (3) 

and 

$2 = {ei, ei, e 2 , e 2 , e 3 , e 3 , . . . , e n , e n }, (4) 

with {ex, . . . , e n } being an orthonormal basis for 7i. If s — n + 1, then the crude, customary 
measure of redundancy coincides for $i s and $2- However, intuitively the redundancy of 
$x,s seems to be very localized, whereas the redundancy of $2 seems to be quite uniform. 
The fact that $2 can be split into two spanning sets, but $i jS cannot, gives further support 
to this intuition. Also, the frame $2 is robust with respect to any one erasure, whereas 
$i iS does not have this property. Neither of these facts can be read from the customary 
redundancy measure, which makes it rather unsatisfactory. 

Concerning infinite-dimensional Hilbert spaces, research has already progressed, and we 
refer to the recent publication [2] (see also pQ). In this paper, the authors provide a mean- 
ingful quantitative notion of redundancy which applies to general infinite frames. In their 
work, redundancy is defined as the reciprocal of a so-called frame measure function, which is 
a function of certain averages of inner products of frame elements with their corresponding 
dual frame elements. More recently, in [TJ, it is shown that ^-localized frames satisfy several 
properties intuitively linked to redundancy such as that any frame with redundancy greater 
than one should contain in it a frame with redundancy arbitrarily close to one, the redun- 
dancy of any frame for the whole space should be greater than or equal to one, and that the 
redundancy of a Riesz basis should be exactly one, were proven for this notion. However, as 
stated, these notions of redundancy only apply to infinite frames. 

1.3. An Intuition-Driven Approach to Redundancy. Concluding from the previous 
subsection, there does not exist a satisfactory notion of redundancy for finite frames, which 
forces us to first build up intuition on what we expect of such a notion. In order to properly 
define a quantitative notion of redundancy, we will agree on a list of desiderata that our 
notion is required to satisfy. 
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Inspired by the two examples ([3]) and (j3J), which our notion of redundancy shall certainly 
distinguish, we realize that the local concentration of frame vectors should play an essential 
role. Hence a local notion of redundancy is desirable. Based on this, suitable global re- 
dundancy measures should be the minimal and maximal possible local redundancy attained. 
This philosophy also coincides with the philosophy of density considerations upon which 
the notion of redundancy for infinite frames is built [21 [1] , since lower and upper densities 
have been studied multiple times giving suitable measures for local concentrations (see |15j). 
Coming back to ([3]) and (j4j), ideally, the upper redundancy of (j3J) should be s and the lower 
1, whereas the upper and lower redundancies of (J4j) should coincide and equal 2. More 
generally, if a frame consists of orthonormal basis vectors which are individually repeated 
several times, then the lower redundancy should be the smallest number of repetitions and 
the upper redundancy the largest. This should still hold true if the single frame vectors are 
arbitrarily scaled, since resilience against erasures as one main aspect of redundancy should 
intuitively be invariant under this operation. 

But even more, for general frames, redundancy should give us information, for instance, 
about orthogonality and tightness of the frame, about the maximal number of spanning 
sets and the minimal number of linearly independent sets our frame can be divided into, 
and about robustness with respect to erasures. Ideally, in the case of a unit-norm tight 
frame, upper and lower redundancy should coincide and equal the customary measure of 
redundancy, which seems the appropriate description for this very particular class of frames. 



1.4. Desiderata. Summarizing and analyzing the requirements we have discussed, we state 
the following list of desired properties for an upper redundancy TZ§ and a lower redundancy 
of a frame $ = (y^)^ for an n-dimensional real or complex Hilbert space 7i. 

[Dl] Generalization. If $ is an equal-norm Parseval frame, then in this special case the 
customary notion of redundancy shall be attained, i.e., = = —. 

[D2] Nyquist Property. The condition = 1Z\ shall characterize tightness of a normal- 
ized version of <£>, thereby supporting the intuition that upper and lower redundancy 
being different implies 'non-uniformity' of the frame. In particular, TZ^ = = 1 
shall be equivalent to orthogonality as the 'limit-case'. 

[D3] Upper and Lower Redundancy. Upper and lower redundancy shall be 'naturally' 
related by < < TZ\ < oo. 

[D4] Additivity. Upper and lower redundancy shall be subadditive and superadditive, 
respectively, with respect to unions of frames. They shall be additive provided that 
the redundancy is uniform, i.e., 1Z~^ = 

[D5] Invariance. Redundancy shall be invariant under the action of a unitary operator on 
the frame vectors, under scaling of single frame vectors, as well as under permutation, 
since intuitively all these actions should have no effect on, for instance, robustness 
against erasures, which is one property redundancy shall intuitively measure. 

[D6] Spanning Sets. The lower redundancy shall measure the maximal number of spanning 
sets of which the frame consists. This immediately implies that the lower redundancy 
is a measure for robustness of the frame against erasures in the sense that any set of 
a particular number of vectors can be deleted yet leave a frame. 
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[D7] Linearly Independent Sets. The upper redundancy shall measure the minimal number 
of linearly independent sets of which the frame consists. 

It is straightforward to verify that for the special type of frames consisting of orthonormal 
basis vectors, each repeated a certain number of times, the upper and lower redundancies 
given by the maximal or minimal number of repetitions satisfy these conditions. The chal- 
lenge is now to extend this definition to all frames in such a way that the properties are 
preserved. 

1.5. Contribution of this paper. The contribution of this paper is two-fold. Firstly, we 
introduce a list of desiderata that a rationally defined quantitative notion of redundancy for 
a finite frame shall satisfy. Secondly, we propose a notion of upper and lower redundancy 
which will be shown to, in particular, satisfy all properties advocated in those desiderata. 

2. Defining Redundancy and Main Result 

2.1. Definitions. As explained before, we first introduce a local redundancy, which encodes 
the concentration of frame vectors around one point. Since the norms of the frame vectors do 
not matter for concentration, we normalize the given frame and also consider only points on 
the unit sphere § = {a; G : ||x|| = 1} in Ti,. Hence another way to view local redundancy 
is by considering it as some sort of density function on the sphere. 

We now define a notion of local redundancy. For this, we remark that throughout the 
paper, we let (y) denote the span of some y G T~i and P( y ) the orthogonal projection onto 

<v>- 

Definition 2.1. Let $ = {<Pi)f = i be a frame for a finite- dimensional real or complex Hilbert 
space H. For each x G §, the redundancy function 1Z<$> : § — > M + is defined by 

N 

n q> {x) = Y,\\P(^)\\ 2 - 

i=i 

We might think about the function 71$ as a redundancy pattern on the sphere, which 
measures redundancy at each single point. Also notice that this notion is reminiscent of the 
fusion frame condition [6], here for rank-one projections. 

The following observation is rather trivial, but useful. 

Lemma 2.2. //$ = ((pi)f =l is a frame for a finite- dimensional real or complex Hilbert space 
Ti,, then the redundancy function 1Z<$> assumes its maximum and its minimum on the unit 
sphere in Ti. 

Proof. By definition, the function 1Z§ is continuous. Moreover, since the unit sphere in finite 
dimensions is compact, the function attains its extrema. □ 

This consideration allows us to define the maximal and minimal value the redundancy 
function attains as upper and lower redundancy. 

Definition 2.3. Let $ = {<pi)f =l be a frame for a finite- dimensional real or complex Hilbert 
space H. Then the upper redundancy of $ is defined by 

= maxTZ$(x) 
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and the lower redundancy of $ by 

TZ^ = min 7Zq> (x) . 
Moreover, $ has a uniform redundancy, if 

This notion of redundancy hence equals the upper and lower frame bound of the normalized 
frame. Surprisingly, this notion will be shown to satisfy all desiderata we phrased. 

2.2. Main Result. With the previously defined quantitative notion of upper and lower 
redundancy, we can now verify the desired properties from Subsection 11.41 explicitly in the 
following theorem, whose proof will be given in Section [5j 

Theorem 2.4. Let $ = (y>i)f =1 be a frame for an n- dimensional real or complex Hilbert 
space 7i. 

[Dl] Generalization. //$ is an equal-norm Parseval frame, then 

N 
n 

[D2] Nyquist Property. The following conditions are equivalent: 
(i) We have = 1Z\. 



7^-$ — 7^"$ — 



(ii) The normalized version of $ is tight. 
Also the following conditions are equivalent. 



(i'J We have TZ^ = 11% = 1. 
(ii') $ is orthogonal. 
[D3] Upper and Lower Redundancy. We have 

o < < n% < oo. 

[D4] Additivity. For each orthonormal basis (ej)" =1; 

Moreover, for each frame $' in Ti, 

7^$u<i>' — ^~ and TZ^^, < 7Z^ + 7Z$i . 

In particular, if $ and $' /jai>e uniform redundancy, then 

[D5] Invariance. Redundancy is invariant under application of a unitary operator U on 
H, i.e., 

under scaling of the frame vectors, i.e., 

^f^.,n \N = T^fyi (-i scalars, 



and under permutations, i.e., 

<± 
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[D6] Spanning Sets. $ contains [TZ^\ disjoint spanning sets. In particular, any set of 

[TZ$\ — 1 vectors can be deleted yet leave a frame. 
[D7] Linearly Independent Sets. If $ does not contain any zero vectors, then it can be 

partitioned into linearly independent sets. 

2.3. Examples. Let us now analyze the running examples ([3]) and (jlj) from Subsection 11.41 
as well as introduce and analyze one additional frame. We will show that the upper and 
lower redundancies precisely equal those values, which we intuitively anticipated a reasonable 
notion to attain. We will further exploit Theorem 12.41 to derive additional information about 
the frames. 

Example 2.5. satisfies 

K$ ls = 1 and TZt ls = s. 
This can be seen as follows. By definition, 

N n 

T**j?) = E h^w^ii 2 = s i^ e i)i 2 + E ifo*) i 2 - 

i=l i=2 

Hence 7£$ ls (ei) = s. For x ^ e\, letting q = (x,ei), 

n 

^*i, s ( X ) = SC l + E C 2 = ( S ~ X ) C 1 + 1 < (5 - 1) + 1 = S- 

i=2 

This implies 72.^ s = s. Moreover, 

^$ 1>s (e2) = 1 < 7£$ 1>s (x) for all x 7^ e 2 , 

which implies 72- J l = 1. 

Exploiting [D2], the frame is neither orthogonal nor is it tight. [D6] tells us that <3>i iS 
can be split into 1 spanning set, which is indeed the maximal number, since, for instance, 
C2 occurs one time and is orthogonal to all other elements from the frame. Concluding from 
[D7], $i )S can be partitioned into s linearly independent sets, which can be chosen as {ei} 
s — 1 times and {ei, . . . , e n }. It is also evident that this is the minimal possible number, since 
the s vectors G\ need to be placed into separate linearly independent sets. Naturally, the 
frame $i jS can be normalized to become a tight frame. The upper and lower redundancies 
however remain the same, since only the system of normalized vectors is considered. 

Example 2.6. $2 possesses a uniform redundancy. More precisely, 

7^ 2 = 2 and ft+ = 2. 

This follows from 

N n 

K^{x) = E l|iW*)|| 2 = 2E \M\ 2 = 2 ' 

i=X i=l 

and taking the max and the min over the sphere. 

Notice that $2 is a 2-tight frame. Hence the uniform redundancy coincides with the 
customary notion of redundancy as the quotient (2n)/n = 2 by [Dl]. Further, by [D6] and 
[D7], $2 can be partitioned into 2 spanning sets and also into 2 linearly independent sets. 
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Those partitions can here in fact be chosen to be the same, more precisely, can be chosen to 
be the two orthonormal bases of which $ 2 is composed. 

Example 2.7. We add a third example in which the frame is not merely composed of vectors 
from the unit basis {ei, . . . , e n }. Letting < e < 1, we choose $ 3 = (fi)fLi as 

= f ei : i = l, 

Vi ~ \ VT^e 1 e l + se t : % ^ 1. 

This frame is strongly concentrated around the vector e±. We first observe that 

N N 

rc* 3 (ei) = ll P ^>( e i)H 2 = 1 + Yl K ei > ^"^i + ^)| 2 = 1 + ( N ~ !)(! - £2 )- 

i=l t=2 

However, this is not the maximum, which is in fact attained at the average point of the 
frame vectors. But in order to avoid clouding the intuition by technical details, we omit this 
analysis, and observe that 

1 + (N -l)(l-e 2 ) <nl 3 <N. 

Since 

N N 
i=l i=2 

we can conclude similarly, that 

< 7^ 3 < e 2 . 

The frame $3 shows that the new redundancy notion gives little information near the 
extreme cases: 1Z~ ~ and 1Z + ~ N, but becomes increasingly more accurate as 1Z~ and 
1Z + become closer to one another (cf. the discussion after Theorem I4.ll) . By [D2], the frame 
$3 is not orthogonal, nor is it tight. [D6] is not applicable for this frame, since L^i 3 J = 
although there does exist a partition into one spanning set. Hence, [D6] is not sharp, but 
becomes telling, if 1Z~~ > 2. Now, [D7] implies that this frame can be partitioned into N — 1 
linearly independent sets. Again, we see that we can do better than this by merely taking 
the whole frame which happens to be linearly independent. As before, we observe that [D7] 
is not sharp for large values of TZ + . However, these become increasingly accurate as 1Z~ and 
1Z + approach N/n (again we refer to the discussion following Theorem 14.1 p . 

3. Characterization of Redundancy Functions 

As we just saw, the notion of redundancy is built upon the notion of a redundancy function. 
Hence to analyze the notion of redundancy more closely, we will investigate characteristic 
properties of redundancy functions. 

Interestingly, the redundancy function itself is a useful object to exploit. Assume we use 
a frame $ to encode a vector x into its frame coefficients to prevent data loss if some of 
the coefficients are erased (lost or unpractically delayed). Indeed, any input vector can still 
be perfectly recovered if the set of frame vectors belonging to coefficients, which are not 
erased, form a frame or equivalently, if the associated redundancy function is strictly 
positive. However, 1Z<&i contains useful information even if this is not the case: For any 
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input vector x and any residual set <J>', the projection of x onto the orthogonal complement 
of the zero set of 1Z<$,i can be recovered. In practice, the input and the erasures are typically 
random, and only some information about their distribution is known. To achieve a small 
distortion of the transmitted vector, it is then desirable to choose the frame in such a way 
that the input vectors are concentrated near the orthogonal complement of the (random) 
zero set of TZ^i. This is a new type of frame design problem arising from the redundancy 
function, which we will investigate in detail elsewhere. 

The first observation we make in this context is that a frame is not uniquely specified 
by its redundancy function, since we can scale the single frame vectors arbitrarily, yet the 
frame is still associated with the same normalized frame. Thus, searching for a frame which 
possesses a predefined redundancy function is in fact searching for the following equivalence 
class. 

Proposition 3.1. Let F be the set of frames for a finite- dimensional real or complex Hilbert 
space TL. Then the relation ~ on F defined by 

$ ~ $ ft^ = ft^ 

is an equivalence relation on F. 

Proof. All three conditions, reflexivity, symmetry, and transitivity are immediate by defini- 
tion of the relation. □ 

The just introduced equivalence relation can be described in a different way by linking the 
redundancy function with the associated frame operator. For this, we require the following 
notion: For a frame $ = {<fi)f = i in TL, we let 5$ denote the frame operator with respect to 
the normalized version of $, i.e., 

N 
i=l 

Further, we denote the associated quadratic form by 

Q&(x) = (Sa,x,x), 

and note that (2$ extends 1Z§ to all x G TL. 

We recall that indeed, there is a one-one correspondence between positive (semi-)definite 
operators and quadratic forms. 

Theorem 3.2. f2T\ Theorem 3.5] Each positive (semi-) definite, bounded operator A on a 
real or complex Hilbert space TL is uniquely determined by the associated quadratic form 
Q A {x) = (Ax,x), xeTL. 

The essence of the proof is the so-called polarization identity. For real Hilbert spaces, we 
have 

(Ax, y) = -(Qa(x + y)- Q A (x - y)) 

and for the complex case 

(Ax, y) = ^{Q A {x + y)~ Qa(x - y)) + '-(Q A (x + iy) - Q A {x - iy)) . 
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We use this fact to establish when two frames belong to the same equivalence class. 

Corollary 3.3. If $, $ are two frames for a finite-dimensional Hilbert space 7i, then the 
following conditions are equivalent. 

(i) 1Z$, = IZy on §. 

(ii) S§ = onH. 

Proof. The redundancy function of a frame T extends to all x G 7i by the quadratic scaling 

Q T {x) = \\x\\ 2 -Ky{x/\\x\\), 

which defines a quadratic form and thus is equal to Qr{x) = (Syx,x). Since the quadratic 
form Qy and the operator Sr are in one-to-one correspondence by Theorem 13.21 equality 
of the redundancy function for two frames $ and \l/ is equivalent to the normalized frame 
operators being identical. □ 

It follows from Corollary 13.31 that equivalent frames $ and i.e., 1Z<$> ~ TZ^, must have 
the same number of non-zero frame vectors. That is, the number of non-zero frame vectors 
is the sum of the eigenvalues of the equal frame operators 5$ = Sq,. 

Since tight frames are in some sense the most natural generalization of orthonormal bases, 
one might ask whether each equivalence class contains at least one tight frame. It is easily 
seen that, for each N > n, one of the equivalence classes contains all the unit norm tight 
frames with iV vectors plus non-zero multiples of their frame vectors, i.e. {ci§i)f =l , with 
Q ^ 0. Other classes may contain tight frames. For example, the equivalence class of the 
frame $i jS contains the Parseval frame 

{s _1 / 2 ei, . . . , s _1 ' 2 ei, e 2 , . . . , e n }, where e± occurs s times. 

In general, an equivalence class need not contain any tight frames at all. For example, 
consider the frame $3. This is a unit-norm linearly independent set, whose frame operator 
is not a multiple of the identity, but the sum of its eigenvalues is n. Now assume towards a 
contradiction that there exists a tight frame \1/ = (^1)1=1 i n ^s equivalence class. Then - as 
just mentioned - we must have that m = n, hence it must be an equal-norm orthogonal set. 
This implies IZq, = Id-^ 7^ lZ<s> 3 , a contradiction. 

Given a positive self-adjoint rank-ra operator S on 7i, we next characterize when it coincides 
with the frame operator of a normalized frame. 

Proposition 3.4. Let T be a positive, invertible operator on a real or complex Hilbert space 
H with eigenvalues Ai, . . . , A n . Then the following conditions are equivalent. 

(i) There exists a frame $ = (ipi)f = i with <pi 7^ for all i such that T = £><&. 

(ii) There exists some N e N, N > n such that 



n 

8=1 



A QUANTITATIVE NOTION OF REDUNDANCY FOR FINITE FRAMES 



11 



Proof, (i) (ii). By (i), T is the frame operator associated with the normalized version of 
$. Hence the trace of T satisfies 

N n 

tr[T] =tf=X>,/M|f = 5> i , 

i=X j=l 

and the number of frame vectors has to satisfy N > n because $ is spanning, 
(ii) =>- (i). Let (ej)" =1 be the orthonormal eigenbasis of T such that 

T&i -^jCj, i 1, . . . , n , 

and assume the sum of the eigenvalues is an integer N > n. By a result from [131 E|> there 
exists an equal-norm frame $ = (tpj)f =1 having T as its frame operator, with = 1 for 
all i G {1, 2, . . . n}. This implies S$ = S$, thus T = S$ as required. □ 

We remark that Proposition 13.41 is constructive, because the inductive proof in [131 E] 
provides such a frame. 

To prepare the characterization of redundancy functions further, we recall Gleason's the- 
orem. 

Theorem 3.5. [H] Let 7i be a Hilbert space of dimension n > 3, and let g : § — > 6e 
chosen such that 

n 

^2g(e n ) = 1 

i=l 

for any orthonormal basis {ei, e2, . . . e n }. TTien i/iere exists a trace-normalized positive defi- 
nite operator T such that (Tx,x) = g(x) for all x G S n . 

We need a slight generalization of this theorem. 

Corollary 3.6. Let TC be a Hilbert space of dimension n > 3, let N > 0, and let g : E> — > Eq 

be chosen such that 

n 

i=i 

for any orthonormal basis {ei, e 2 , . . . e n }. Then there exists a positive definite operator T 
with tr[T] = such that (Tx,x) = g(x) for all x G §. Moreover, g is strictly positive if and 
only ifT is invertible. 

Proof. The first part is a simple scaling argument. The second part of this corollary follows 
from the first one because the minimum of g is the smallest eigenvalue of T. □ 

We are now ready to state and prove the main result of this section which provides a 
complete characterization of all functions on the sphere which are redundancy functions of 
an equivalence class of frames. 

Theorem 3.7. Let f : § — > IRq"? ^ be an n-dimensional real or complex Hilbert space with 
n > 3, and let q be the extension of f to H, given by q(0) = and q(x) = ||x|| 2 /(x/||x||) for 
any i^O. Let uo denote the probability measure on the unit sphere which is invariant under 
all unitaries. Then the following conditions are equivalent. 
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(i) There exists a frame $ for 7i such that 

f(x) = Tl<f>(x) for all x G S. 

(ii) The function f is strictly positive on S, its extension q satisfies the parallelogram 
identity 

q(x + y) + q(x — y) — 2(q(x) + q(y)) for all x, y G § 
and f integrates to 

f(x)duj(x) = N/n 



with some integer N > n. 
(iii) The function f is strictly positive on § and there exists an integer N > n such that 
for any orthonormal basis {ei, e.^, . . . e„}, 

8=1 

Also the following conditions are equivalent. 

(i') There exists a unit-norm tight frame $ for 7i such that 

f(x) = lZ$,(x) for all x G §. 

(ii') There exists some integer N > n such that 

f(x) = N/n for all x G S. 



Proof. We first focus on the equivalence of (i) and (ii). For this, notice that, by Corollary l3.3[ 
(i) is equivalent to the existence of a frame $ for 7i such that f(x) = \\sH 2 x\\ 2 for all x G S, 
where S$ is positive and invertible. Since, by [TO], each positive, invertible operator is 
the frame operator of an equal-norm frame, (i) is equivalent to the existence of a positive, 
invertible operator S satisfying f(x) = ||S ,1 / 2 x|| 2 for all x G S. Hence (i) is equivalent to / 
defining a new norm 

\\S^ 2 x\\ 2 = f(x) =:\\\x\\\ 2 
on 7i which, by Lemma 13.31 satisfies 

1 1 \x\ 1 1 2 = (Sx, x). 

Since this defines a new inner product on Ti by (x,y) = (Sx,y), (i) is equivalent to the 
fact that the norm defined by / is induced by an inner product. Hence, by the Jordan-von 
Neumann theorem [16], condition (i) is equivalent to the parallelogram identity. Moreover, 
the operator associated with the quadratic form q can be written as a sum of orthogonal 
projection operators if and only if its trace is a positive integer. This amounts to 

/ f(x)du(x) = N/n, for some positive integer N , 
Js 

see, for example, the proof in [31 Proposition 3.2]. Finally we observe that / is strictly positive 
if and only if iV > n, because otherwise the sum of projections would not be invertible and 
thus would not yield a frame operator. 
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To verify the equivalence of (i) and (iii), we note that given a frame <3> we can always 
remove vanishing vectors from it without changing TZ§. Since 1Z§ extends to the quadratic 
form of the normalized frame operator S$, its trace satisfies tr[5$] = N, N being the 
number of (non-zero) projections summed to obtain 5$. This trace can be computed in any 
orthonormal basis, so 

n 

tr[£*] = J^ftc^e;) = N. 

i=l 

Conversely, we recall that the version of Gleason's theorem stated in Corollary 13.61 yields 
that any / satisfying the summation condition extends to the quadratic form of an operator 
T. Moreover, T is invertible because / is assumed to be strictly positive on §, and thus T 
is the frame operator for some $. Again invoking [13], the frame can be assumed to be unit 
norm, thus T = S$ = S$. 

The equivalence of (i') and (ii') follows from Lemma [4.21 □ 

We remark that the hypothesis n > 3 is only relevant for the equivalence with (iii), since 
the proof of these equivalences exploits Gleason's theorem. 

We further remark that the previous theorem is in fact constructive, since the Jordan-von 
Neumann theorem together with the polarization identity can be used to explicitly compute 
the frame operator S$ associated with a function / : 8 — > M.q which extends to a quadratic 
form. Then, using the technique in [TBI E] , an associated unit-norm frame can be explicitly 
constructed. 

It is not clear to us, what the correct equivalent condition would be, if we drop the word 
'unit-norm' in (i'). This concerns the question of a characterization of normalized frames 
which come from tight frames. This in turn is closely related to the still open question of 
when the frame vectors can be scaled so that a tight frame is generated as well as to the 
question of which equivalence classes contain a tight frame. 

4. Upper and Lower Redundancy 

Having studied and characterized redundancy functions, we now focus on the notion of 
redundancy itself and will provide more insight into it, in addition to Theorem 12 .41 

When introducing a new notion, one of the first questions should concern its range. The 
following result will provide precise information about the range of the upper and lower 
redundancy, and even characterize when there does exist a frame such that a particular pair 
of values for upper and lower redundancy can be attained. 

To avoid inessential complications, we again exclude the case of frames which contain zero 
vectors. 

Theorem 4.1. Let $ = (<Pi)iL\ be a frame for a real or complex Hilbert space 7i having 
dimension n > 2 and let <pi ^ for all i G {1,2, ... , N}. The upper and lower redundancies 
of $ then satisfy the inequalities 

N 

o<n^<-<ni<N. (5) 

n 

Moreover, iflZ$ = — or = —, then the normalized version o/$ is a tight frame. 
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Finally, let n < N, t\ G (0, — ], and r 2 G [— ,N). Then the following conditions are 
equivalent. 

(i) There exists a frame $ = {(fi)f =1 for 7i, n > 2, such that 

Kg = T\ and TZ% = r 2 . 

(ii) We have 

{n — l)ri + r 2 < N. 

In particular, for every t\ G (0, — ] and every r 2 G [— ,N), we can find unit-norm frames 
$ = 04=i and ¥ = (ipi)fLi with 

Kg = r i and IZy = r 2 . 

Proof. For the proof of (jHJ), we recall from the proof of Theorem 13.71 that N/n is the mean 
value of / with respect to the probability measure uj on the sphere §, which implies 



f N 
min7^$(x) < / 1Z<b(x)cbu(x) = — < max Us, (x) 

x-es Js n x& 



(6) 



Furthermore, since the vectors in $ span the finite dimensional space 7i for each x, there 
exists some i G {1, . . . , N} such that (x, <fi) ^ 0, and hence ||-P(^)(^)|| 2 > 0. This yields 

< Tig. (7) 

Finally, we have 

N N 

K*{x) = \\ p {<Pi){x)\\ 2 < W X W 2 = N for all a; G§. (8) 

i=l i=l 

Now assume that we have equality in (jSJ) for some i£§. This implies that 
II^V)(z)H 2 = (P( Vi ){x),x) = \\xf for all i G {l,2,...n}, 

and thus x is an eigenvector of eigenvalue one for all -P/^). Since each P( Vi ) is rank one and 
projects on the span of tpi, either x = or all tfi are collinear. However, if all (fii are collinear, 
they cannot span 7i if its dimension is n > 2. Hence, it follows that 

n+ < n. (9) 

Combining (El), (J7J), and (jHJ) proves (EJ). 

For the moreover-p&rt, we notice that if Kg = — , then the average of 1Z& equals its 
minimum. This implies u({x G § : 1Z$(x) > N/n}) = 0. Now the continuity of 7Z$ ensures 
that it is constant. 

Next we study the equivalence between (i) and (ii). To prove (i) =>■ (ii), let $ — {ipi)^ = i 
be a frame for Ti which without loss of generality we can assume to be equal-norm. Then 
assume that the frame operator for (<£>i/||y>i||)£Li has eigenvalues 

Kg = n = X l < A 2 < . . . < A n = r 2 = K%. 

From this, 

n 

(n - l)n + r 2 < X i = N > 
i=i 
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hence (ii) follows directly. 

For the converse direction, we observe that (ii) implies the existence of real numbers 
ri = Ai < A2 < . . . < A„ = r 2 satisfying 



i=i 

By Proposition 13.41 we can find an equal-norm frame ((pi)f =1 whose frame operator has 
eigenvalues Ai, . . . , A n . Since 



the frame {ipj)f =1 is even unit-norm. This proves (i). 

It remains to prove the in particular-part. On the one hand, given r% G (0, — ], we choose 
T2 — — ■ Hence (ii) is satisfied, and by the equivalence of (i) and (ii) there exists a frame 
$ = {<pi)f = i for H so that 7Z$ = r±. If, on the other hand, we are given r 2 G then 
we may choose r\ G (0, ^] small enough such that (i) is satisfied. Again, arguing as before, 
there then exists a frame $ = {y>i)f =1 for 7i so that = r 2 . 

The proof of the theorem is complete. □ 

We remark that Theorem 14.11 is constructive, since already Proposition 13.41 - which was 
employed to show existence of an equal-norm frame in the equivalence of (i) and (ii) - was 
constructive. 

Let us now, for a moment, analyze the previous result in light of the interpretation of TZ J 
provided by [D6] in terms of partitioning $ into spanning sets and of 7^ provided by [D7] 
in terms of partitioning $ into linearly independent sets. If the redundancy is not uniform, 
both partitions might not coincide. However, if the redundancy is uniform, hence the values 
of 7Z$ and both equal N/n, the partitions suddenly can be chosen to be the same. In 
fact, [1] shows that in this case we can partition our frame into |_^J linearly independent 
spanning sets plus a linearly independent set. We remind the reader that Examples 12. 5\ I^B] 
and 12.71 already gave a hint of the fact that [D6] and [D7] become sharper as they approach 
the value N/n. 

In case of an equal-norm frame, the upper and lower redundancy is immediately computed 
from the frame bounds. 

Lemma 4.2. Let $ = (ipi)f =1 be an equal-norm frame for a Hilbert space Ti, having frame 
bounds A and B. Set c = ||y?j|| 2 for all i = 1, . . . , N. Then 



n 




N 



£lHI 2 = 5> = ;v, 



i=\ j=i 



— and 

c 




Proof. By definition, 



N 



N 



c-^Kx,^)! 2 . 



i=l 



i=l 
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The claim now follows from the characterization of the frame bounds 

N N 

A = min > \(x, tpi)\ 2 and B = max ) \(x,ipi)\ 2 . 

i=l i=l 



□ 



Another question concerns the change of redundancy once an invertible operator is applied 
to a frame. This, in particular, relates the upper and lower redundancies of a frame to those 
of its canonical dual. 

Lemma 4.3. Let $ = (y?i)£Li be a frame for a real or complex Hilbert space 7i. For any 
invertible operator T on H, 

K(T)- 2 Ki<K± m <K(T) 2 Ki, (10) 

where k(T) = ||T|| ||T _1 || denotes the condition number of'T. 

In particular, if S$ denotes the frame operator associated with $ ; and $ denotes the 
canonical dual frame of $, then 

Proof. For each x G S, assuming without loss of generality that tfi ^ for all i, 

n Tm {x) = jr \\p invi)) (xw < E = \\n 2 \\T-rn*(x). 

i=i i=i " 

Now maximizing or minimizing over x £ § implies "R^r$\ < ll^ll 2 !!^ -1 1| 2 ^$- The lower 
bound IITH^IIT" 1 !!" 2 ?^ < Tl^^) follows similarly. 

~ —1 il/2n 

The in particular-part follows by recalling that <3> = S^ 2 ^, by the identity \\S$ \\ = 
H^l 1 !! 1 / 2 , and by applying jTD]). □ 



5. Proof of Theorem 12.41 

[EQ] If $ = (<pi)g 1 is an equal-norm tight frame for an n-dimensional real or complex Hilbert 
space H, then 

N N 

n*{x) = £ \\P im) (x)f = |Mr£K*.v<>l 2 = \M- 2 = -■ 

i=l i=l 



[E(2j (i) ^ (ii). This follows immediately from Lemma 14.21 

(i') =>- (ii'). Towards a contradiction, assume that $ is not orthogonal. Without loss of 
generality, <p\ JL (<p 2 , ■ ■ ■ , <Pn)i i n particular, ipi ^ 0. Hence, choosing x = <^i/||<£>i||, we 
obtain 

N 

^(x) = i + Eii^ 1 ir 2 iip^ ) (x)ii 2 >i. 

i=2 
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Thus 1Z% > 1, a contradiction to (i'). 



(ii') =>- (i'). Let x G §. Since (<£i/||¥>i||)i=i is an orthonormal basis, we obtain 



A? 



n${x) = E \\ p {vt)( x )\\ 2 = W X W 2 = L 



i=l 



This implies 



= max1l<f,(x) = 1 = min1Z<f,(x) = 11%. 



[D(3] By definition, 1Z~ < 1Z + . Moreover, since $ = {(fi)f = x is a frame for H, also (<£>i/||<£i||)£Li 
is spanning Ti, where without loss of generality we assume that tpi ^ for all i. Hence 
(<£i/ll¥>i||)i=i forms a frame for H, and thus possesses a positive lower frame bound, i.e., 

TV 

^ = infV||P ( ^(x)|| 2 >0, 



i=l 



as well as a finite upper frame bound, i.e., 



TV 

U+ = SUp V \\P{ Vl )(x)\\ 2 < 00. 

[DHj The first claim follows from the basic observation that 

TV n TV 

E n^w*)ii 2 + E ii j w*)ii a = E n*w*)ii a + 1. 

i=l i=l i=l 

which implies 

Next, let $' = (<^i)i=i- Then, for each x G §, we have 

TV M 

^w(^) = Eii p ^)( x )ii 2 +Eii p ^ 

Hence 



i=l i=l 



as well as 



7£ $u $, = min 7£ $u $, (x) > min7^(a;) + minK^x) = TZ^ + 7^,. 



^*u*' = max ^$u*' ( x ) — niax^(x) + max 7^, (x) = 7?.J + 7£j,. 

3? £ S x'^S x £ S 



The in particular-part follows immediately from here. 
[D(5] For each x G §, 

TV 



1=1 
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Since ||£/*(x)|| = 1, we conclude that Tt^}^ = "R>%- 

Invariance under scaling and under permutation of the frame vectors is immediate from the 
definition of upper and lower redundancies. 

[D(6] Without loss of generality, we can assume that each frame element ipi is non-zero. Since 
IZ^, is the lower frame bound of the frame (y?i/||y?;||)ili, it follows from [I] that (Vi/H^ilDili 
can be partitioned into |_7^iJ spanning sets. Hence, (y?j)™ =1 can also be partitioned into [7Z§\ 
spanning sets. 

The in particular-part follows automatically from here. 

[D(7j Let S be the frame operator of the frame (^i/ll^ilDili) where we assume that ^ 
for all i. Then {S~ l / 2 {^i/\\^i\\))f =1 is a Parseval frame and 



^-ld n < S- 1 < —ld H . 



Hence, for all z = 1, 2 N, 



Next we check the Rado-Horn condition (see [7j). For this, let / C {1,2,..., N}, and let P be 
the orthogonal projection of {S~ l l 2 {(pi/^i^))f =l onto span (S' -1 / 2 ^/!!^!!))^. Employing 
the fact that (S~ l l 2 (Lpi/\\ipi\\))f =l is Parseval as well as the estimate ffTTT) . we obtain 

N 



dim^^/H^IDiiGT) = J2W P ( S ~ 1/2 ^/\M))\ 

i=l 

> ^Hp^- 1 / 2 ^/!!^!!))! 



> 



^ii5-- i/2 (wii^n)ir 

iei 
\I\ 

LU < 7?+ (\2) 

dimiS-y^/WifiW) : i e I) " ' 1 1 

By the Rado-Horn theorem [7], condition (fl2l) implies that (S~ l l 2 (tpi/\\i£i\\))f =l can be par- 
titioned into \TZ + ~\ linearly independent sets. Since S~ l l 2 is an invertible operator, it follows 
that (y?i/||y?j||)ili - and hence also (tpi)f =1 - can be partitioned into \7Z + ] linearly indepen- 
dent sets. 



Summarizing, 
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